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Description 



A PLAYER TECHNIQUE CONTROL SYSTEM FOR A STRINGED INSTRUMENT AND 

METHOD OF PLAYING THE INSTRUMENT 

RELATED APPLICATION 

This application is based on and claims priority of U.S, Provisional Application Serial 
No. 60/476,943, filed June 9, 2003, entitled A MOTION CONTROLLED STRING 
INSTRUMENT for all common subject matter. 
5 FIELD OF THE INVENTION 

The invention relates primarily to the art of stringed musical instruments and 
particularly to man-machine interfaces for use with such instruments. The invention may be 
used with any stringed instrument. The guitar is often cited herein by way of example, but all 
aspects of the invention are intended to apply to all fundamentally similar stringed 
10 instruments, fi'etted and unfretted, acoustic and electrified. 



BACKGROUND OF THE INVENTION 



Prior art stringed instruments have included simple electromagnetic or piezoelectric 
pickup both witii and without signal processing effects and guitar "sustainers" that employ a 
feedback loop around the tensioned string to produce prolonged notes. 



15 



The instant invention differs fi-om or improves upon these known devices and makes 
possible better sounding stringed instruments that may be more pleasurable to play. 



CONTRAST TO SUSTAIN SYSTEMS 



25 



20 



In a sustainer system, a signal produced by a pickup in proximity to a string is 
amplified and applied back to the string via a separate actuating transducer, creating feedback 
that regenerates string vibration. By employing signal processing in this feedback loop, it is 
possible to achieve some selection and control of the modes of vibration. For example, the 
sustainer invention of U.S. Patent No. 5,233,123 ("M23 patent") operates on this principle and 
has a switch that selects feedback preferential either to the fundamental string frequency or to 
its harmonics. However, sustainers cannot damp the strings and do not provide precise 
control over string harmonics. 
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In a preferred embodiment and as pointed out in U.S. Patent No. 6,216,059 ("'059 
patent"), the controller operates a single transducer as a sensor during the first part of a time 
frame and as an actuator during the second part of a time frame such that sequential repetition 
of said time frame produces a piece- wise approximation to continuous control. 
5 An embodiment of the invention is operable with a simple sustainer, but provides 

fewer benefits than preferred embodiments employing motion control, as it is imabie to 
precisely damp vibration or control timbre. 
DEFINITION OF TERMS 

The term "sensing/actuating transducer" refers to a transducer system (e.g., one or 
10 more transducers) capable of providing an output signal in accordance with the motion of the 

string and capable of affecting a change in the string's motion in response to an actuating 
signal. Preferably the sensing/actuating transducer is a single unitary transducer as described 
in my '059 patent. 

The term "controller" refers to a system, e.g., of the type described in my earlier '059 
15 patent, which receives output signals from the sensing/actuating transducer and control 

signals, e.g., reference signals and applies actuating signals to the sensing/actuating transducer 
to modify the motion of the string. 

The term "supervisor" refers to a supervisory system with signal storage facilities and 
data processing capabilities capable of interpreting certain input from the user referred to as 
20 preselected player techniques in the form of selected characteristic features of the string's 

motion via the sensed output signals and provides control signals to the controller to govern 
the behavior of the controller accordingly. It is to be noted that the controller and supervisor 
need not be in the form of separate components and that some functions may be interchanged. 
The term "timbre" refers to the harmonic spectrum of a note. 
25 The term "techniques" refers to actions every guitarist learns to perform to achieve a 

certain nuance or effect in playing his instrument. Playing techniques include but are not 
limited to vibrato and glissando or bending of the string, muting the strings, and various styles 
and methods of plucking and muting the strings such as the deliberate touching of harmonic 
nodes of strings. 

30 The term "control signal" refers to any signal used to control something. 
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The term "technique command" refers to a control signal that represents the deliberate 
will of the instrumentalist, much as if he had turned a dial or closed a switch. Technique 
commands are also referred to herein according to the type of technique used to issue them, 
i.e., a "vibrato command" or a "glissando command". Note that most such commands are 
continuous in both magnitude and time. For example, when an instrumentalist uses vibrato to 
control the invention it is akin to riding a joystick as against flipping a switch. 

The term •'recognition" is used herein to convey the idea of a system mimicking a 
human cognitive process, in that the system recognizes a human player's intent encoded in the 
characteristics of the musical signal created by the player. 

The terms "path" or "data path" refer to a virtual or physical digital communication 
connection that is understood to be capable of carrying mixed data including a plurality of 
signals in both directions. 

The term "time frame" refers to the time taken to iterate the control loop once, i.e., the 
time between one sensing event to the next, i.e., the reciprocal of the control system sample 
rate with respect to the use of a imitary transducer as descried in the '059 patent. 

The term "muting" refers to an action performed by the instrumentalist and can be a 
technique command. 

The term "damping" is performed by a motion control system. Damping may be the 
response to a muting command of technique. 

The terms "musician", "player", "guitarist" and "instrumentalist" are used 
interchangeably and should herein be taken to mean, "the player of any stringed instrument". 
OVERVIEW OF THE INVENTION 

The invention combines means to sense and influence the vibration of guitar strings 
together with a novel method of user control, that of extracting and interpreting the guitarist's 
playing techniques as purposeful user commands. 

The means of sensing and influencing strings comprise at least one sensing/actuating 
transducer coupled to each string to be controlled for sensing the motion and for effecting a 
change in the motion of the string via a supervisor/control system in response to recognized 
player techniques. 

The skilled guitarist akeady uses techniques as commands given to his conventional 
instrument. For example, when he desires vibrato, he "commands" it, usually by slightly 
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modulating the tension of the string with his fretting hand. In the instant invention, such 
playing techniques are recognized by a supervisor and interpreted as user commands to the 
electronics of the invention. According to the invention, by means of such playing techniques 
the instrumentalist controls electronic parameters that are otherwise often controlled through 
cumbersome ancillary interfaces such as switches, dials, foot pedals and the like. 

The invention employs the knovm concept of feature extraction where features of 
vibrations including but not limited to amplitude, pitch, spectra, note onset and mute are 
continuously recorded and analyzed to identify musical playing techniques as conunands. For 
example, pitch is analyzed over time to recognize and quantify vibrato and a corresponding 
vibrato command signal is issued. Such command signals either serve directly as inputs to the 
vibration influencing means or they alter the selection of inputs to said means. 

These combined elements of the invention empower the guitarist to use playing 
technique to affect the vibration of the strings of his instrument to a far greater and more 
varied extent that was available to him before the invention. He can sustain notes or chords at 
will, mute notes more easily, and produce a variety of timbres and harmonic effects never 
before possible. He can hear the sounds produced both acoustically and with amplification, 
and he can control everything directly as he plays, without resorting to a multitude of 
switches, dials and foot pedals. 
OBJECTS/EMBODIMENTS OF THE INVENTION 

Recognition of Technique Commands. 

The general concept of controlling digital audio processing effects by means of control 
signals derived from features of the sound itself or from other sounds is known. See P476 of 
the book entitled DAFX-Digital Audio Effects published by John Wiley & Sons Ltd.© 2002 
("DAFX"). That concept has been applied to music synthesizers and effects devices that 
process audio signals. An object of the instant invention is to build upon the concepts of 
feature extraction and analysis to extract intentional commands from an instrumentalist* s 
purposeful technique. When combined with a means to influence string vibration in 
accordance with said commands, this constitutes a unique apparatus and new method of a 
musical instrument. 

Motion Control System with Full Harmonic Control 

A preferred embodiment of the invention provides means to sustain independently 
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upon each tensioned string of an instrument the vibration of some selection of harmonics 
while simultaneously damping some other selection of harmonics, said selections being 
governed by a reference spectrum. The '059 specifies such means. This and any other such 
means, when coupled with a user command interface responsive to playing techniques would 
fall within the scope of property of the instant invention. 
Waveform Reference Signal 

In an aspect of preferred embodiments of the invention, generated or stored time 
domain waveform signals are applied as reference actuating signals to excite vibrations upon 
the associated string or strings. 

Time and Frequency Domain Reference Signals 

A preferred embodiment of the invention uses both time-domain and frequency 
domain reference inputs. The motion control system of the '059 patent provides for both time- 
domain and firequency domain reference inputs. 

Damping Open Strings 

A preferred embodiment of the invention interprets and extends a guitarist's muting 
technique to actively damp sympathetic vibrations occurring on unplayed "open" strings to 
silence unwanted sounds. 

Electronic String Excitation 

A preferred embodiment of the invention provides means to electromagnetically 
"pluck" or otherwise excite string vibration where none exists. 
Mute Technique as a Command Signal 

A preferred embodiment of the invention recognizes the instrumentalist's intentional 
acts of muting the strings and provides a technique command signal therefirom. 
Vibrato Technique as a Conmiand Signal 

A preferred embodiment of the invention derives a technique command signal from 
vibrato technique. The guitarist applies vibrato technique when he "shakes" or bends a string 
back and forth with his fretting hand to make the pitch waver or uses a vibrato arm. 

Vibrato Rate Technique as a Command Signal 

In a further embodiment of the invention, the rate of vibrato is measured and extracted 
as a command signal. 
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Glissando Technique as a Command Signal 

A preferred embodiment of the invention derives command signals from upward and 
downward glissando. 

Vibrato and Glissando Control Sustain and Timbre 

In preferred embodiments of the invention, the magnitude of the Vibrato command 
signal governs the intensity of the sustain effect while the Glissando command signal governs 
timbre, or the reverse, or one and not the other. 

Note Onset Amplitude Technique as a Command Signal 

A preferred embodiment of the invention derives a command signal from the greatest 
amplitude detected when a new note is struck. 

Note Onset Spectrum as a Reference Spectrum 

A preferred embodiment of the invention derives a reference spectrum from the 
spectrum of the note as measured at the instant the string is struck by the guitarist. 
Spectral Balance Command Signal 

A preferred embodiment of the invention derives a command signal from the 
normalized spectral centroid of the string vibration. Seepage 362 of DAFX. This signal 
measures how the spectral energy of string vibration is distributed between high and low 
harmonics. Such a control signal approximately indicates where in relation to the bridge the 
string was struck. 

One embodiment of the invention uses the harmonic balance command signal as a key 
that selects a particular reference spectrum from a stored palette of spectra. Thus, by striking 
a note a certain way or at a certain point on the string, the player can invoke a certain timbre. 

Last String Played Conunand Signal 

A preferred embodiment of the invention has a mode where only the last string played 
is permitted to vibrate while the rest of the strings are actively damped. In this mode, it is 
possible to play arpeggios by holding and strumming chords, even on an acoustic instrument. 

Pitch Correction Aspect 

In a preferred embodiment of the invention, there is a user-selectable aspect that acts 
to pull the pitch of each note towards a stored pitch standard such as an equal tempered scale. 
As the tensioned string is part of a harmonic oscillator, by the action of the motion control 
loop, the pitch of the string can be pulled a few cents in either direction from its natural pitch 
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by said control system, peraiitting minor tuning errors and errors of glissando to be corrected. 
Recording of String Attributes and MIDI output 

In a preferred embodiment of the invention, vibration feature history in memory is 
analyzed and expressed as a MIDI or other standard protocol for controlling and 
communicating with other audio equipment for the purpose of controlling said equipment or 
of turning a performance into a musical score, i.e., automatic transcription. 

Phrase Recognition Conunand Signal 

In a preferred embodiment of the invention, phrase recognition is used in conjunction 
with a simple switch to invoke modes of the invention. Recently recorded pitch history of the 
strings is reviewed and compared against deliberately recorded sequences of pitch herein 
called a "command phrase". The guitarist uses said switch to invoke a temporary phrase- 
recognition mode of the invention when he desires to enter a musical command phrase. He 
then enters one or a series of notes. The entered phrase is compared agamst stored command 
phrases. When a matching sequence is found, the system responds by entering the mode of 
operation associated with the sequence, thereby executmg a phrase command. 

Techniques Used in Combination 

In preferred embodiments of the invention, the various playing techniques and the 
command control signals they generate can be used in any useful combination to control 
various aspects of the invention's behavior at once. 

In preferred embodiments of the invention the value of one control signal can 
optionally change the value, polarity or curvature of a second control signal. 

Basic Physical Controls 

In a preferred embodiment of the invention, the guitarist interacts with a minimum 
number of easily accessible manually operable physical controls. The controls may be of any 
suitable kind such as a touch-sensitive area, capacitive, mechanical, etc. 

In a preferred embodiment of the invention there is a physical control for switching 
from one mode to another mode of the invention, a physical level control to set the level of the 
electrical audio signal output from the invention, and a physical control to turn off and on the 
invention's electronics. There is also an optional touch-sensitive area for selecting along an x- 
axis the harmonics to be influenced or optionally the strings to be influenced and for 
controlling along a y-axis the degree of sustain and muting. Other embodiments of the 
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invention may have more physical user controls. 

Defining an Instrument by Mapping Technique Command Signals to Control System 
Behaviors. 

In a preferred embodiment of the invention, a control mappmg matrix is bounded on 
one axis by all possible technique-derived control command signals and along the other axis 
by all possible system behavioral inputs. Using a Manufacturer's Setup Utility software, 
selected functions or "scripts" can be mserted at any subset of cross points in the matrix for 
the purpose of establishing the relationship between particular command signals and particular 
behavioral inputs. The mapping and scripts of all such elements together with sets of reference 
waveforms and spectra constitutes an "instrument definition". For example, an instiaiment 
definition of a guitar would be one set of waveforms, specti-a and scripts and a banjo would 
have another. 

Instrument Definition Design Utility Software 

In a preferred embodiment of the invention, as a means of setting up the instiiunent 
rather than of playing the mstiiraient, a "Manufacturers Set-up Utility" computer program 
running within the invention or on any suitable external computer connected to the invention 
tiuough a communication link enables a manufacturer or instiument designer to define the 
character and behavior of a particular model or brand of an insti^ent employing the 
invention. Said behavior is established by prescribing tiie assignment and interrelationship of 
tiie various technique-derived command signals and by supplying and storing unique reference 
spectra within the electi-onics of the invention. Thus one manufactiirer who develops a product 
for sale that employs tiie instant invention can differentiate his product from all others by 
developing his own prescription for control behaviors and endowing the instrument witfi his 
own choice of sounds, all witfiout modifying a standardized hardware apparatus of tiie 
invention. 

Use With Known Sustain Systems 

Reduced but still novel and musically useful functionality is obtained by coupling tiie 
"Recognition of Technique" aspect of the invention witii existing sustainer systems. 

In a preferred embodiment of tiie invention, a conti-ol signal representative of vibrato 
could be used to control tiie amount of sustain delivered to a string by a conventional sustain 
system such as tiie sustainer described in tiie ' 123 patent provided tiiat tiiis sustainer was 
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modified to accept such a control signal input governing its sustain action. 

All such uses are anticipated in the instant invention and would fall within its scope of 
property. 

Additional User Interfaces 

A further embodiment of the invention accepts, via an auxiliaiy user interface 
connection, mode or behavioral control signals from an auxiliary user interface. 
Plurality of Instrument Definitions 

In a preferred embodiment of the invention a plurality of instrument definitions is 
stored within the each instrument according to the invention. A change of mode is required 
when changing from one definition to another. This is conceptually equivalent to putting 
down one instrument and picking up another. 

Computer Interfaces 

In a preferred embodiment of the invention, means are provided to download, store 
and upload internal states of the instrument. Such state records can be stored, examined and 
edited on a computer. Aspects of the instrument's behavior can be customized in this way. 
Another use of this facility is to transfer instrument definition settings from one instrument to 
another, or simply to back up the settings in case the electronics of the instrument fail or the 
instrument is lost or stolen. 

In a preferred embodiment of the invention the external computer interface of the 
invention has the capability of downloading replacement computer and digital signal 
processing executable computer code for all internal programs of the invention. This code 
downloading feature makes it possible to correct programming errors and to advance the art of 
the electronics without having to change physical components within the instrument. Within 
the invention, a kernel of persistent code that cannot be overwritten provides this basic 
communication and code download functionality. 

Audio Interfj^s 

In preferred embodiments, audio input and output is handled both as an analog signal 
and in standard digital formats. 
Secondary Pickup Set 

In an alternate aspect of all embodiments, the outputs of a set of individual string 
bridge pickup transducers are digitized and analyzed to extract string attributes, either instead 
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Of or in conjunction with the sensor channel outputs of the motion control transducer. A 
bridge pickup responds to all planes of vibration of the string whereas a magnetic pickup 
deployed beneath a string senses only the normal components of string motion. Using the 
outputs of the secondary pickups for analysis does not violate the fundamentals of the control 
system of the '059 patent; as before, the unitary transducer performs all frame-by-frame 
motion control activity. 

In a preferred embodiment, the secondary pickup is of a type that does not respond to 
the electromagnetic field of the control ttansducer. 
Orthogonal Transducers 

In a prefen-ed embodiment of the invention, there may be two control systems and two 
transducers coupled to each string of the instrument, where the transducers are arranged 
orthogonally so that a string vibration in a plane parallel to the face of one transducer will be 
normal to the face of the other, this arrangement providing for improved control of all string 
vibrations. This and other combinatorial variations and arrangements of transducers are 
anticipated and all fall within the scope of the instant invention. 

External Audio Signal as a Spectral Reference 

In a preferred embodiment, there are one or more audio inputs that accept either analog 
signals or signals in a standard digital form. Any audio signal, including sounds from any 
synthesizer, can be applied to such inputs. The spectra of these audio inputs are continuously 
extracted using Fourier methods and can optionally serve as a "live" or "real time" spectral 
references, allowing for example an instrumentalist's voice to control the timbre of the 
instrument. When an audio input is present, it automatically overrides other spectral 
references. 

Physical Deployment in an Instrument 

A preferred embodiment of the invention incorporates and integrates the electronics of 
the invention with an acoustic instrument or solid body instrument so as to create a new 
instrument that to the player seems as a unified whole rather than as an instrument with 
attached electronics. An electronic subsystem containing some or all of the required functions 
of the invention replaces the bridge and saddle of a conventional instrument. If needed, a 
second subsystem of the invention is housed inconspicuously within the instrument body. 
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SUMMARY OF THE INVENTION 

A system for modifying the vibration of at least one string (and preferably each string) 
of a stringed instrument in response to preselected player techniques involving selected 
characteristic features of the string's motion includes, at least one transducer, coupled to the 
string for providing a sensing output signal in accordance with the motion of the string and for 
effecting a change in the string motion in accordance with an actuating signal. Preferably the 
transducer (or orthogonally airanged transducers) is of the unitary transducer type as described 
in the '059 patent. The sensed output signals are stored in a memory to provide a history of 
the string's motion and features of such motion are extracted. A supervisory system, which 
may include the memory, reviews the extracted features to determine when said features 
substantially correspond to one or more preselected player techniques. In response to the 
recognition of a preselected player technique(s) the supervisor provides a control signal to a 
controller, which in response thereto and applies an actuating signal to the transducer to 
modify the string's motion in accordance with the recognized technique. For example, a set 
of pattern matching rules representative of string motion associated with the preselected 
player techniques, allows the extracted features to be tested against the rules. A programmer 
may establish and record the rule set, e.g., at a manufacturing site, or the rule set may be 
generated and recorded by the supervisory system during a training session depending upon 
the processor architecture employed. The preselected player techniques may include vibrato, 
glissando, etc. Additionally, a waveform server may be provided for supplying excitation 
waveforms to the controller, and the supervisory system may provide for storage and retrieval 
of spectral templates as well as a general storage means for retaining system data. A battery 
or fuel-cell and recharging means or wire connection means may be included for supplying 
power to the system of the invention during use. Analog and digital data and audio inputs and 
outputs may also provided for connecting the instrument to other electrical devices such as an 
external user interface device, computer or an audio amplifier. 
BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of the basic elements of the invention connected to a guitar- 
like stringed instrument; 

Fig. 2 is identical to Fig. 1, except for individual secondary string pickups; 

Fig. 3 is a block/schematic diagram of a controller depicted in Fig. 10 of the '059 
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patent; 

Fig. 4 is similar to Fig. 3 with the input to the actuator linearized by a square root 
calculation; 

Figs. 5 and 6 illustrate orthogonal transducers; 

Fig. 7 illustrates a motion controller configured to attach to a simple sustainer system; 

Fig. 8 shows details of pitch estimation and spectral and amplitude feature extraction; 

Fig. 9 is a block diagram showing details of the supervisor; 

Fig. 10 is a graphic depiction showing the vibrato technique recognition process; 

Fig. 1 1 is a graphic depiction showing the glissando technique recognition process; 

Fig. 12 is a block diagram showing the note onset technique recognition process; 

Fig. 13 is a block diagram showing the muting technique recognition process; and 

Fig. 14 illustrates a simplified matrix of the command executive process. 

In all figures, except Fig. 9, elements that are replicated for each string but are 
otherwise identical are subscripted. In the text these subscripts are used only when it is 
necessary to differentiate between instances of an element. If no subscripts appear, then the 
material is intended to apply equally to all instances of the element. 
EXCLUSION OF ORDINARY DETAILS 

Routine aspects of software and hardware known to one with ordinary skill in the art 
of designing digital signal processing systems as being necessary to the functioning of such 
software and hardware systems are not described herein. As a partial example, such things as 
software stacks, buffering and scaling amplifiers, hardware clocks, memory controllers, DMA, 
etc., are assumed obvious and not shown or described herein for clarity. Conversely, 
wherever ordinary details are included herein, it is done for clarification and does not impose 
a duty to include such details throughout. 
DETAILED DESCRIPTION OF THE INVENTION 

Patents Included by Reference 

The control system used in the preferred embodiment of the instant invention is 
described in the '059 patent and the contents of the patent are incorporated herein by 
reference. The descriptions and waveforms presented in the '059 patent are applicable to the 
instant invention. The '059 patent incorporates signal processing to extract spectra from a 
string's motional signal, to compare said spectra to a reference spectra, and to adjust a control 
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function to compel the string's motional spectra to match the reference spectra. 

The '123 patent provides an extensive examination of basic sustainer technology and 
the contents thereof is included herein by reference. 

U.S. Patent No. 3,813,473 ("'473 patent") shows an early sustainer system using 
mechanical feedback and the contents thereof are also included herein by reference. 

The Supervisor 

The instant invention introduces an apparatus and method (known herein as the 
"supervisory system" or "supervisor") for recognizing the intentions of an instrumentalist and 
responding in the form of specific control system behaviors. The supervisor captures 
information from all strings of the instrument over time and governs the actions and behaviors 
of all the individual motion controllers according to the instrumentalist's intent. 

The Transducers 

All figures herein show transducers as simple solenoids. It is understood that all 
known-transducer types, shapes and configurations tfiat will comport with the operating 
principles of the invention can be substituted for the transducers shown herein and shall fall 
within the scope of the invention. 

Figure 1 

A preferred embodiment of the invention is shown in Fig. 1 . It is sufficient to show 
guitar 10 as having three strings 12a-c but it could have any number of strings 12. The number 
of motion controllers 20 would follow the number of strings. 

Strings 12 are anchored and tensioned between bridge 18 and any suitable fixture such 
as tuning pegs at the end of the neck. In close proximity to strings 12 are pickups 16. User 
controls 14 are positioned on the instrument for convenient access and can be of any suitable 
design including touch surfaces, rotating or sliding potentiometers, switches and etcetera. 

In Fig. 1 , bridge 1 8 may optionally have a piezoelectric or other kind of pickup that 
responds to string vibration but not to the electromagnetic actuating fields produced by 
pickups 16. 

Fig. 1 shows the invention in conceptual form. Interconnection lines represent the flow 
in information but not necessarily physical connections. Accordingly, routine aspects of 
processing systems such as analog to digital and digital to analog conversion stages are not 
shown. Communication lines 22, 28, 32, 34, 82 and 88 are shown for conceptual clarity as 
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proceeding from one fimction block to another, whereas the actual paths of such information 
within the system of the invention may pass through a memory subsystem, also not shown in 
Fig. 1 . The more abstract functional objects shown are realizable in hardware, software or 
both. 

Mixer 26 

In mixer 26, audio outputs 22 are selected and mixed with an optional bridge pickup 
signal 48 to produce electrical output signal 50. Signal 50 may be a stereo or multichannel 
signal, and can be in any form including digital and optical. Supervisor 30 communicates with 
mixer 26 over path 28 and can exchange time or frequency domain data and control all mixer 
parameters. Mixer 26 routes instantaneous waveform data 22 and 48 for storage in memory 
250 of the supervisor, (see Fig. 9). 

Motion Controllers 20 

Motion controllers 20 are of the type presented in the '059 patent, which is a unitary 
transducer control system having a "reference" terminal that governs the amplitude and 
harmonic spectrum of a vibration and an "external input" terminal that accepts time domain 
reference vravefoims to excite vibration. Minor aspects of the '059 invention have been 
reconfigured for integration into the instant invention as will be presently described. 

Referring to Fig, 1 of the instant invention, each pickup 16 is connected to a motion 
controller system 20. Each motion controller system 20 is configured to accept a time domain 
input 34 and a frequency domain reference input 84, and to provide an audio ou^ut 22 and a 
frequency domain output on data conununication path 88 representing the most current pitch 
and spectra of string vibration. 

The spectral and time domain inputs can be used in conjunction. For example, a time 
domain input can excite the string across a broad harmonic spectrum and the spectral 
reference input can cause unwanted harmonics to be selectively damped. 

It is understood that a spectral reference signal conveys the amplitude target of every 
partial of note vibration and therefore also controls overall note amplitude. 

Waveform Server 36 

Waveform server 36 delivers specified time domain waveforms to the time domain 
reference inputs of motion controllers 20. This input corresponds to that labeled "Ext. Input, 
1 54" in figure 10 of the '059 patent. Said waveforms may be prerecorded in supervisor 30 or 
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the waveform server may synthesize them as needed, or they may be provided externally over 
audio path 40, whereby waveform server 36 is equipped to accept external analog or digital 
audio signals. Waveform server 36 has a communication path 32 for exchanging waveform 
and control data with supervisor 30. 
Supervisor 30 

Supervisor 30 delivers spectral reference, data and control signals 84 to an input of 
motion controllers 20 corresponding to that labeled "Reference, 156" in Fig. 10 of the '059 
patent. Data path 80 connects the supervisor to an optional auxiliary user interface. A digital 
interface 41 connects the supervisor to a data network or to a computer. Supervisor 30 
controls mixer 26 via data path 28. Supervisor 30 accepts real-time spectral information about 
strings 12 from motion controllers 20 on data lines 88. and it provides reference spectra to the 
motion controllers on path 84. The supervisor also exchanges mode control instructions and 
status information with motion controllers 20 via lines 84 and 88. 

Manual controls 14 communicate control signals to supervisor 30 over path 38 and 
include, but are not limited to, a on/off switch 2, a mode switch 4, and a level adjustment 6. 

Guitar 10, bridge 18, strings 12 and transducers 16 are all physical objects. Manual 
controls 14 may be purely physical, i.e., mechanical switches, or they may be realized as an 
LCD touch screen or other advanced interface. Each motion controller 20 has physical power 
electronics for the purpose of applying power to its transducer 16 and has physical sensing 
electronics for reading the transducer output signal. All other aspects of Fig. 1 are realizable 
using any suitable programmable device including but not limited to a computer, a digital 
signal processor and a programmable logic device. 

Parallel Control Systems 

Any number of motion controllers 20 can be operated in parallel proximity providing 
that their timing is aligned and synchronized. When the timing is aligned, each controller 
delivers its actuation pulse at a first same time as all others and all controllers sample their 
input channels at a second same time. Each sensing channel is thereby time-isolated from both 
its own actuating channel and from the actuating channels of adjacent controllers. 

Figure 2 

In a preferred embodiment, Fig. 2 serves instead of Fig. 1. Fig. 2 is identical to Fig. 1 
except for individual string bridge pickups 52. which are of a type responsive to all planes of 
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string vibration but not to electromagnetic actuating fields, a divided piezoelectric bridge 
pickup being one such type and except for an optional control area 6 within manual controls 
14 that is operated by a player's fingers and which provides an x-axis for selecting and 
manually commanding excitations upon strings in a first mode or selecting harmonics in a 
second mode, and controlling a continuvim between muting and sustaining along the y axis in 
both modes . 

String vibration signals 48 firom pickups 52 are sent to the analysis inputs of motion 
controllers 20 and to mixer 26. 

In Fig 2, motion controllers 20 are configured to accept signals 48 for spectral analysis 
rather than sensing channels signals from the unitary transducers. 

Figure 3 

Figure 10 of the '059 patent is reproduced here as Fig. 3. 
Figure 4 

Fig. 4 shows the modifications made to Fig. 10 of the '059 patent to configure the '059 
control system for use in the instant invention. Motion controller block 20a is detailed but all 
such controllers 20 are understood to be identical. 

The portions of the fimctionality within a block 20 may be realized by entirely digital 
means. The fimctionality of the pulse width modulator portion may be realized as a digital 
pulse width modulator. Such implementation options will be apparent to one with ordinary 
skill in the art. 

Reference designators within block 20a are those of the original Fig. 10 of the '059 
patent. Reference designators outside of block 20a are of the instant invention. 

Block 150/new contains an absolute value calculation followed by a square-root 
calculation. The maximum signal amplitude is assumed to be one unit and thus is unchanged 
by the square-root fimction. The '059 patent uses a pulse width modulator having a 
discontinuous output current. Such modulators are known to have a square law transfer error. 
The force integral applied to the string in each time frame is proportional to the square of the 
pulse width during that time frame whereas is desirable that it should be linearly proportional. 
By replacing block 1 50 with block 1 50/new as shown, this transfer error is eliminated. 

If an optional bridge pickup having individual pickups for each string is present, 
analog to digital converter subsystems 54 are also present, of which A/D 54a is illustrated. 
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A/D 54a digitizes the bridge pickup signal for compatibility and is preferentially of a fast 
instrumentation type rather than a sigma-delta type. 

As an example of the routine exclusion of ordinary details, it would be obvious to one 
vsdth ordinary skill in the art that the A/D 54 subsystem must contain analog pre-amplification 
5 responsive to the high impedance output of a pickup 52 to present a correctly scaled, low 

impedance signal to an analog to digital converter. It is understood that this one example 
serves for the entire instant document wherever other details of a similarly routine nature are 
omitted. 

Old block 158 is replaced by 158/new, a pitch estimator and spectrum analyzer that 
10 can be configured to accept input data originating from either signal 22a, the sensor time 

channel of the unitary transducer, or from 48a, the signal from secondary bridge pickup 52a, 
provided that the particular embodiment has such a bridge pickup. 

Motion controller 20a provides the most current pitch and spectra of string 12a on data 
path 88a. Within block 20a, snubber components 106 and 102 are transposed to a series 
1 5 rather than parallel arrangement for lower thermal loss. 

Figs. 5 and 6: Dual Orthogonal Control System for Each String 
Fig. 5 shows two orthogonally arranged unitary transducers 16al and 16a2 coupled to 
a string and displaced along the string so that their fields do not combine. As such transducers 
interact only with vibrations normal to the plane of the sensing surface, this arrangement of 
20 two transducers provides control of vibration that is independent of the plane of vibration. 

Each transducer is coupled to a separate unitary control system. Controller 20al 
interacts with the string on one plane of vibration while controller 20a2 interacts with the 
string on a second orthogonal plane of vibration. The two controllers compose a force vector 
that matches the actual plane of vibration of the string, 
25 Fig. 6 shows an alternative implementation of dual transducers. A switch 62a connects 

the first and then the second unitary transducer to a single control system 20a during alternate 
time frames. Time frame marking pulse 58a from within controller 20a is divided by 2 in 
block 60a and the resulting control signal switches controller 20a transducer connection 24a 
altemately at alternate time frames. 
30 Fig. 7 Use with Sustainers 

Fig. 7 is a derivation of Fig. 4 modified for use with sustainer technology and shows a 
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modified motion controller 20a' interfaced with separate actuating and sensing transducers 
interacting with string 12a. The subsystem of Fig. 7 applies equally to all strings 12. 

It is also within the scope of the instant invention that transducers 64 and 66 could be 
widened to encompass more than one string 12. Such a system would be less expensive as it 
might have only one or two motion controllers 20, but still capable of useful sustain effects. 

Within block 20a' of Fig. 7, all components directly supporting the imitary transducer 
of Fig. 10 of the '059 patent have been removed. What remains within block 20a' are those 
aspects of a motion controller 20 that comport witfi a conventional sustainer system. Outside 
of block 20a', separate sensing and actuating transducers and amplifiers 66a, 64a, 72a and 74a 
have been added. 

Sensing transducer 66a develops an electrical signal 70a analogous to the motion of 
string 12a. Said signal is amplified by 74a and becomes sensor output signal 160. 

As described in the *059 patent, a spectral control loop operates to generate a 
correction signal 152 which, after amplification by drive amplifier 72a, is applied as signal 
68a to a separate actuator 64a where it interacts electromagnetically with a ferrous string 12a. 

Such use with sustainers employs the other novel aspects of the instant invention 
whereby technique command signals derived firom the string's motion cause adjustments to the 
actuator signal affecting string motion. As the sustainer does not have the precision or the 
damping capability of the '059 patent, embodiments that depend on muting and precise control 
of timbre are not possible when using basic sustainer technology. However, it is still possible 
to use the magnitude of a vibrato or glissando technique commands to control the amount of 
sustain. Manipulation of the filter bank transfer functions will still produce interesting 
harmonic effects. It is much as if one had a car with a gas pedal but without brakes; such a car 
would still be capable of transportation, but its practical utility would be considerably 
lessened. 

It is possible to increase the precision of control and some degree of damping within a 
string motion control loop having a separate sensor and actuator. The circuitry and software 
objects of block 20a' provide for virtually any feedback method in the control loop. An 
improvement to basic sustainer technology is made by combining said block 20' with 
advanced but known adaptive and adaptive-predictive control technology. Such control 
system methods are described in U.S. Patent No. 6,662,058, "Adaptive Predictive Expert 
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Control System", U.S. Patent No. 5,426,720, "NeurocontroUed Adaptive Process Control 
System", and U.S. Patent No. 5,361,303, "Frequency Domain Adaptive Control System" and 
these patents and their references are included herein by reference. It is to be noted that 
adaptive method require time for convergence, burden computational resources and require 
5 more hardware and transducers than the control system of the '059 patent. 

US Patent No. 6,610,917 ('"917 patent") lists most of the known possibilities of the art 
but fails to mention, specify or describe the invention of identifying and measuring vibrato 
and glissando in the motional pitch signal of a string(s) nor of using the resulting vibrato and 
glissando signals as commands to effect changes in the timbre or amoimt of sustain of said 
1 0 string(s). Unlike the '91 7 disclosure, the instant invention identifies the superior utility of 

these particular possibilities from within other less useful possibilities and describes specific 
means and methods necessary for their reduction to practice. 
Fig. 8: Pitch Estimation and Spectral Analysis 

Within all motion controllers 20 is a block labeled 158 new that performs pitch 
1 5 estimation and spectral analysis, (PESA). The method to be described is computationally 

intense but very fast and suitably accurate. 

The input to the PESA process is the most recent history of time-domain string 
motional data 200 continuously recorded within memory 250 (Fig. 9). The span of waveform 
history data 200 must contain at least two complete cycles of the expected lowest frequency 
20 fundamental of string vibration, and is determined by the range of the stringed instrument. 

From said motional data 200, PESA extracts pitch and spectral feature signals and sends them 
to memory 250 over data path 88. 

Waveform 200 is representative of fypical waveforms derived via pickups fi-om string 
vibration. The software program "MathCad" was used to generate the graphs shown according 
25 to the calculations of the PESA process. Process 204 performs auto correlation of the first 

half of data 200 against the last half of data 200 and generates data 206. The variables ka and 
kb are index vectors with range = (0..(n/2.1)), and n=512 in the example and is dependent 
upon the sample rate in practice. 

Process 208 searches through data 206 for a point 'P' representing the index of location 
30 of the peak of correlation in data 206. The fundamental firequency, (pitch), is given by the 

expression, where n = the number of points in the data set and LF = the fi«quency 
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coiresponding to the last point. Process 210, having knowledge of the fundamental, 
resamples the original data 200 to fit exactly two cycles of the fundamental within a 
convenient radix-2 FFT input record. This is done so there is no spectral "bleeding", so that a 
perfect short FFT can be executed on the data. 
5 Process 2 1 2 executes a radix-2 FFT on the resampled data and produces a spectrum of 

harmonic magnitude versus fi^quency. The first datum is 0 Hz or DC and is not of interest. 
Since two cycles of the first harmonic were fit to the FFT, only even numbered harmonics can 
be valid. If the value of odd-numbered harmonics exceeds a prescribed threshold, it indicates 
an error in the pitch esthnate, i.e., what was thought to be two cycles of the fimdamental 

10 wasn't, and therefore there are unexpected harmonics in the FFT. hi the instance of such an 

error, pitch and spectral output data are ignored and the previous values are substituted. 

A spectrum feature data signal is assembled by taking the even-numbered points of 
FFT magnitude data. Ideally, the PES A process is redone for every new motional sample 
datum, i.e., once each time frame. This stream of pitch and spectral data is stored to memory 

1 5 250 via data path 88 for use by other processes. One of ordinary skill in the art will recognize 

opportunities for improving the efficiency of the PESA algorithms in this context with little 
impact on the quality of results. 

A process 214 performs amplitude feature extraction and provides the cycle RMS, the 
cycle crest factor, and the cycle peak of the associated string vibration as outputs to path 88. 

20 This is conveniently done here using the two exact cycles of data result of process 2 1 0. The 

averaging operation in the RMS calculation is performed across exactly N cycles of the 
waveform. An N of 2 is appropriate. Similarly, the peak value of the waveform occurring over 
N cycles, and the crest factor, which is the cycle peak divided by the cycle RMS, are 
calculated for N cycles of fundamental. 

25 A discussion of other suitable methods of pitch detection is found in an article entitled 

"High Accuracy and Octave Error Immune Pitch Detection Algorithms" by M. Dzuibi'Nski 
and B. Kostek, Multimedia Systems Department, Gda'nsk University of Technology, 
Narutowicza 1 1/12, 80-952 Gda'nsk, Poland. Background to the art of spectral analysis is 
found in Chapter 1 of DAFX and also pgs. 350-357 of DAFX. Almost any method of pitch 

30 estimation and spectral analysis will serve to put the fundamentals of the instant invention to 

practice, but preferred embodiments will benefit firom fast and accurate methods. 
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Non-locality of Components 

The invention anticipates various combinations of subcomponents including but not 
limited to user interface components, transducer components, control components, supervisor 
components and guitar-like instrument components. For practical reasons some of these will 
5 be located in close proximity, i.e., wdll be a part of the mstrument invention in the physical 

sense, while others may be more arbitrarily located but will still be a part of the instrument 
invention in the functional sense. For example, in light of current communication technology 
it is obvious that the supervisor and/or the controller subcomponents or computational 
portions thereof could conununicate with the physical instrument by means of a high speed 
10 long distance data conmiunications medium and thus might be located anywhere from a few 

feet away to many miles away from the instrument itself All such functional combinations, 
whether physically grouped at the instrument or not, are subsumed under the intent and scope 
of this invention. 

DETAILED DESCRIPTION OF THE SUPERVISOR SYSTEM 
1 5 Fig. 9, "Supervisor System Diagram" 

Objects and processes that occur repeatedly according to the number of strings are 

shown as such through the artistic device indicated at 76. The structure presented in Fig. 9 is 

realized through software running on any suitable physical computing subsystem. Fig. 9 

illustrates one possible such software. It is imderstood that the same functionality can be 
20 realized using different but functionally equivalent software structures and all such alternative 

structures are encompassed within the scope of the present invention. 

Subsystem block 78 is understood to contain whichever of Figs. 4, 5, 6, and 7 or 

combinations thereof that comports with the intended embodiment of the instant invention. 

Block 78 presents a consistent interface of motion controllers 20 to the rest of Fig. 9. Within 
25 each motion controller 20 there is a filter bank, a set of multipliers and a spectral magnitude 

subtractor, referenced in the original Fig. 10 of the *059 patent as 170, 172, and 162, 

respectively. Mixer 26 and waveform server 36 are discussed previously with respect to Fig. 

1. 

Supervisor 30 controls all parameters of these processes including the selection of 
30 filter bank functions, i.e., band-pass, all-pass, simple gain or polarity inversions, etc., and can 

also read all register states including the results of spectral subtractions. Within supervisor 
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block 30, Fig. 9 shows a number of process activities, each having a bi-directional interface to 
memory 250 that serves both as data storage and as an inter-process communications medium. 
The inmiediate and historical results of any process are available to all processes through 
memory 250. This basic architecture is of a type known in the field of computer science to 
provide for efficient execution of several concurrent synchronous or asynchronous processes 
that must freely intercommunicate. Any other architecture known in computer science can be 
substituted, provided it supports the required activities of the invention. 

Memory system 250 provides both private and pubUc memory to each process and 
facilitates inter-process communications. Memory 250 provides at least enough space to 
maintain circular memoiy buffers containing current history of all processor outputs sufficient 
to serve the requirements of the invention. Ideally, memory 250 would be large enough to 
record all aspects of several entire musical performances. 

Processes 

In the embodiment herein described, all processes receive input data by accessing it 
within memory 250 and all processes record their output data within memory 80. The inputs 
and outputs of processes as well as all control signal inputs shall all be normalized in range 
and expressed in conunon tenns of magnitude so that any output data of any processor will be 
appropriately scaled to fit within the permitted input data range of any process or control 
signal input. 

Unless stated otherwise, all processes are best executed once during each time frame 
of motion controller 20, as this provides the best performance. If constrained by available 
computing bandwidth, most processes can be executed less firequently without much sacrifice 
of performance. 

A software engineer experienced in writing digital signal processing software would 
commonly be aware of usefiil additions, alternatives and modifications to the algorithms 
described herein. For example, it might improve accuracy to discard a pitch history datum if 
it diverges excessively in value fix)m its adjacent data. Such well-understood details of digital 
signal processing are non-proprietary workshop matters of implementation that are not 
detailed herein for clarity and brevity. 

Earlier processes extract primary features of vibration such as pitch and amplitude. 
Later processes recognize and measure technique commands, which are derived by reviewing 
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said primaiy features using a variety of analytic and rule-based methods. Techniques subject 
to recognition are those that have been preselected during the manufacture of the system of via 
a set-up utility. 

In DAFX, Section 9.4, and portions of Chapters 10 and 12 discuss relevant processing 
techniques and even provide specific programming examples. 
Spectra Server 

Spectra server 256 governs the spectral control loop of motion controllers 20 by 
providing and progressively updating reference spectra from memory 250 over data path 254 
according to the command interpreter as will be described. 

Spectral Balance Process 

A spectral balance process 258 extracts a technique command from string vibration 
spectra as a spectral centroid datum indicative of the balance of energy between high and low 
harmonics of the spectra. Suitable formulae are presented at DAFX, pgs. 362-363. 

Vibrato Technique Recognition Process 

A vibrato technique recognition process 260 is illustrated in Fig. 10. 
Glissando Technique Recognition Process 

A glissando technique recognition process 264 is illustrated in Fig. 1 1 . 

Note Onset Command Detecting Process 

Process 268 for detecting new notes is detailed in Fig. 12. 

Muting Recognition Processes 

When the guitarist purposefully causes notes to become quieter, he has given a mute 
command. A muting process 270 reviews various extracted features and recognizes such 
muting technique as an intentional command. Fig. 13 details a muting recognition process. 

Last String Played Process 

Last string process 274 looks at the note onset signals from all strings and returns to 
memory as a datum the index of the string that was played last. 

A last string played facility is described in U.S. Patent No. 3,813,473 ("'473 patent"). 
According to the '473 invention means are provided for selecting only a string signal that is 
above a threshold and of attenuating all remaining string signals. However, in the '473 patent, 
attenuation is achieved electronically and the strings' vibrations are not actually damped. 

The instant invention has a mode where only the last string played is permitted to 
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vibrate while the rest of the strings are actively damped. 
Phrase Recognition Process 

The phrase recognition process 276 inputs the pitch signals for all strings and the note 
onset signals for all strings. It compares a stored database of musical phrases against phrases 
the musician is actually playing. When it finds a match, it issues a phrase index datum. 

There is a single physical mode switch that permits this datum to be read and 
interpreted as a user mode command. In this way, a single physical switch, used in 
combination with note sequences of any length including 1, enables the instrumentalist to 
control an unlimited number of modal aspects of his instrument including replacing one 
instrument definition with another. 

Processes 278, 280, 282 and 284 communicate with each other and memory 250 over 
path 286. 

Command executive process 280 communicates over data path 286 and defines and 
operates the relationship between technique commands and motion control system inputs. The 
command executive interprets an instrument definition in terms of this relationship and is 
detailed in Fig. 14. 

Instrument Definitions 

Storage area 278 retains instrument definitions. Master program 282 selects which 
instrument definition is made active within command executive 280. 
Master Program 

Master program 282 is responsive to modal inputs such as mode selection signals from 
the phrase recognition process, firom manual controls 14 over signal 38, and from the Aux UI 
80 and digital interface 82 via communication interface 284. 

Master program 282 determines the mode of the invention by activating a selected 
instrument definition. Master program 282 also manages software updates and has the 
capability to replace an portion or all portions of software with replacement software provided 
over digital interface 82. 

Communication interface 284 supports the communication protocols utilized in the 
invention such as 1394, TCP/IP, USB, etc. The addition of appropriate connectors and 
physical layer components needed to support the chosen protocols is understood. 

Fig, 10, Vibrato Process 
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Data path 252 provides the current pitch and recent pitch history 300 to each vibrato 
process 260. The historical span must be long enough to contain at least one full cycle of 
undulation. Two seconds are shown in figure 10 to illustrate both increasing and decreasing 
vibrato. 

Process 302 tracks the peak-to-peak pitch change. The maximum pitch excursion per 
cycle of vibrato by sampling the pitch frequency on every negative zero crossing of the 
derivative of pitch (dp/dt). The corresponding minimum pitch is sampled at every positive 
zero crossing of dp/dt. 

By counting the number of times per second that the pitch signal crosses its own 
average, then dividing by two, the frequency of the modulation of the pitch signal is measured 
and provided to path 252 as a vibrato rate command. 

Process 304 maintains a running average or filtered pitch value. The average or filter 
state is reset by the note onset command and preloaded to the first measured pitch of the new 
note. The vibrato command magnitude is calculated by process 306 using (nonnalizer)*(max 
pitch - min pitch / average pitch) and is smoothed by a short-term running average. The 
"normalizer" is a scaling term to make the range comport with the ranges of other control 
signals. 

Figure 1 1, Glissando Process 

A glissando process requires the most current pitch and the note onset command as 
inputs. Data path 262 provides this and all communication with memory 250. 

Waveform 320 is displayed in the figure to illustrate an example of how pitch changes 
in response to a player's glissando technique. Here, the guitarist "pulls" his string up a tone, 
adds vibrato to the pulled note, and then allows the note to fall back. 

A process 324 calculates the running glissando magnitude by subtracting the most 
current pitch value from a note onset pitch value held by sampler 322. Sampler 322 is gated 
by note onset commands. The resulting glissando command signal is normalized in scale to 
other control signals and sent to memory 250 via path 262. 

Figure 12, Note Onset Detector Process 

Inputs to each note onset process include the most recent pitch, spectral balance, cycle 
RMS and cycle crest factor feature signals. 
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Delays 340. 342, 344 and 346 delay each such input by an amount of time that yields 
meaningful comparisons. Delay values of a few milliseconds would serve for all. 

Threshold comparators 348, 350, 352 and 354 compare the ratiometric difference 
between current and delayed magnitudes of said feature signals against prescribed thresholds. 
If the resulting percentage increase or decrease of any feature signal exceeds its threshold, a 
datum representing the change percentage is delivered to discriminator 356. 

Note onset discriminator 356 is a process that uses rules to test weighted combinations 
of said change percentage data against prescribed thresholds to determine if the 
instrumentalist has deliberately started a new note. For each rule, discriminator 356 sends a 
new set of thresholds to comparators 348, 350, 352 and 354. 

One such rule would be, "If the pitch has changed by more than a semitone, issue a 
Note Onset command." Another such rule would be, "If the Spectral Balance and Cycle Crest 
Factors have shifted upwards but the Cycle RMS remains almost unchanged, issue a Note 
Onset command only if Pitch has been perturbed." 

When a new note is recognized, discriminator 356 sends or updates on path 266, a 
note onset command signal that preferentially has the form of an up counter where 0 indicates 
the onset of a note and where the numeric progress of the counter indicates the time length of 
the note. A note onset command value of zero is used for synchronizing activities to notes by 
several other processes. 

At the instant of note onset, feature sampler 360, connected to memory 250 via path 
266, samples all features extracted from string vibration. This creates and stores to memory 
250 a note descriptor signal that is the set of feature signals current at the time of note onset. 

Figure 13, Muting Process 

The inputs and operations of the muting process are almost identical to those of the 
note onset process. Delays are provided as 400, 402, 404 and 406. The threshold comparators 
are 408, 410, 412 and 414. The rules, thresholds, delays and outputs are different. 

Some of the rules of the mute recognition algorithm are, "If the pitch has not changed 
and Cycle RMS is lower and the spectral balance has tilted down, issue a Mute Depth 
command", and "If the Cycle Crest Factor falls rapidly after a Note Onset and the Cycle RMS 
is declining, issue a Mute Depth command." 
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The output of muting discriminator 416 is a mute depth technique command signal 
representative of the amount or "urgency" of the muting extracted for the associated string, 
and a mute spectrum descriptor. 

A note onset command received on path 272 clears all mute process output signals. 

Process 418 makes ratiometric comparisons of a past note spectrum as provided by 
delay 420 and a present note spectrum, to create a mute spectrum descriptor. An updated mute 
spectrum descriptor is sent to memory 250 on path 272 whenever the mute depth signal causes 
process 418 to sample the descriptor. 

The mute spectrum descriptor indicates which harmonics were suppressed during the 
player's muting of the string and v\iiich were not. 

The significance of the mute spectrum descriptor is made greater by the other virtues 
of the mvention. For example, by touching the string at nodes of selected harmonics, the 
player will mute other harmonics save the selected one. If he is also applying sustain-inducing 
vibrato, the selected harmonic will rise out of the note. 

Figure 14 

Figure 14 shows command executive 280 brings together all the technique commands 
and feature signals that have been explained herein. 

The Motion Control Signals output by Executive 280 are: 

- Waveform server control signals for selecting and setting attributes of waveform reference 
signals output by waveform server 36 as signal 34, (see Fig. 9), 

- Spectra server control signals 254 for selecting and setting attributes of spectral reference 
signals output as signal 84 by the spectral server, (see Fig. 9). 

Mapping matrix 500 presents cross points between input commands and features 518 
and 520, and output motion control signals 522. Horizontal signal lines are inputs while 
vertical signal lines are outputs. Motion control signals 522 pass on path 286 to memory 250 
and then to paths 32 and 254. 

At selectee! cross points, a script such as script 5 12 is installed to execute as a 
continuous sub-process and several scripts can execute concurrently. The active instrument 
definition determines what scripts are installed and where. Said script is a software code that 
defines the relationship between the input control signal and the output control signal of the 
matrix. Any imaginable relationship can be defined, and the script can access other signals to 
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create composite responses. 

Alternative means for achieving substantially the same functionality include, but are 
not limited to, evolutionary algorithms, neural networks and other such architectures and 
method that are trainable and/or self-organizing. Such a system would connect to all inputs 
and outputs shown on Fig. 14, but would require an additional training input to be accessed by 
a manufacturer during a training process. For example, to train such a system to respond to 
vibrato by increasing sustain, one would expose the learning network's Fig. 14 inputs to 
feature signals and technique commands characteristic of vibrato, and one would provide the 
training input with feature signals characteristic of sustained string motion as the desired 
result. Once trained, the supervisory system responds to vibrato with sustain. The result of 
such an approach will still be, in essence, a rule-based system, but the rules will have been 
generated and recorded within the supervisor by the software itself, not supplied by a human 
designer. 

These means and any other known means of establishing a complex relationship 
between one or more input signals and one or more output signals such that provides the 
functions of Fig. 14 falls within the instant mvention's scope. 

Spectrum hypercube 502 is shown having three dimensions 504, 506 and 508 but it 
could have more. It illustrates how several control signals can act together to select a unique 
spectral reference signal from stored spectra. Note that in the example matrix 500, three 
scripts b, f and d are all governing the spectral selection control signal. If spectral balance 
controlled the 504 axis, vibrato controlled the 506 axis and glissando controlled the 508 axis 
of spectrum hypercube 502, a unique spectrum would be selected for every quantized step of 
each control signal. 

Waveform hypercube 510 works just as the spectrum hypercube 502 in selecting 
waveforms according to several control signal inputs. 

Standard pitch table 516 is present to enable the tuning of the instrument to be pulled 
towards a standard tempered scale by the action of motional feedback. This would be done if 
scripts 524 or 526 called for it. 

If in arpeggio mode, scripts 528 and 530 would mute all but the last string played. 
Some matrix scripts such as 512 are shown with a letter enclosed in a circle. Said letter 
corresponds to the instrument definition example given below and shows how the matrix can 
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be used to interpret an instrument definition: 

An Example of an Instrument Definition: 

(a) Open strings sounding below 20% of the average string amplitudes shall be held 
mute by electronic damping. 

(b) The spectral balance of a string's vibration shall select spectral references from a 
set of spectral references indexed by the control signal. 

(c) Pulling a string so that the note rises in pitch shall increase sustain amplitude. 

(d) Pulling a string, plucking it, and then slowly reducing the tension to lower the pitch 
of the note shall cause the note's second harmonic to increase in amplitude and the first 
harmonic to decrease in amplitude. 

(e) A sudden decrease in string amplimde, (as by hand muting), shall enable electronic 
damping of that string. 

(f) If the player applies vibrato to one or more notes in a chord, the chord shall be 
sustained and a predetermined series of harmonics shall be evoked within the vibrations of the 
strings making up the chord. 

(g) If the player plays very close to the bridge of his instrument, each manual plucking 
of a string shall elicit a series of rapid electromagnetic "plucking" actuating events upon that 
string. 

The preceding example is but one of an endless series of instrument definitions made 
possible by the invention. Some definitions will find more favor with musicians than others, 
but all such definitions fall under the scope and intent of the invention. The invention does 
not have one fixed behavior, instead, much as a computer is an invention that allows many 
different programs to be written by progranuners and executed on the same computer 
hardware, the invention allows for many variations of instrument to be defined by instrument 
designers. Thus various different manufactures of instruments employing the instant 
invention can differentiate their offerings according to their design choices, while using a 
standardized hardware embodiment of the invention produced inexpensively in high volume. 



